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Abstract. Let Xi,X2,--- be a sequence of independent and 
identically distributed random variables, and put S n = X\ + • • • + 
X n . Under some conditions on the positive sequence r n and the 
positive increasing sequence a n , we give necessary and sufficient 
conditions for the convergence of Y^nLi T nP(\S n \ > sa n ) for all 
e > 0, generalizing Baum and Katz's (1965) generalization of the 
Hsu-Robbins-Erdos (1947, 1949) law of large numbers, also allow- 
ing us to characterize the convergence of the above series in the 
case where r n = n^ 1 and a n = (nlogn) 1 / 2 for n > 2, thereby 
answering a question of Spataru. Moreover, some results for non- 
identically distributed independent random variables are obtained 
by a recent comparison inequality. Our basic method is to use a 
central limit theorem estimate of Nagaev (1965) combined with the 
Hoffman- J0rgensen inequality (1974). 

Resume.. Soft X\,X2, ... - une suite des variables aleatoires 
independantes et identiquement distributes, et met S n — X\ + - ■ ■ + 
X n . Dans certaines conditions sur la suite positive r„ et la suite 
croissante positive a n , nous donnons des conditions necessaires et 
suffisantes pour la convergence de X^^li T n P(\S n \ > ea„) pour 
tout e > 0, generalisant l'extension de Baum et Katz (1965) de 
la loi de grands nombres de Hsu-Robbins-Erdos (1947, 1949). Ce 
nous permet de caracteriser la convergence de la serie ci-dessus avec 
t„ = -nT 1 et a n = (nlogn) 1 / 2 pour n > 2, repondant a une ques- 
tion de Spataru. D'ailleurs, nous obtenons quelques resultats pour 
des variables aleatoires independantes mais non identiquement dis- 
tribuees, par une inegalite recente de comparaison. Notre methode 
est basee sur une estimee de Nagaev (1965) dans le theoreme 
de limite centrale, en combinaison avec l'inegalite de Hoffman- 
J0rgensen (1974). 



1. Introduction and main result 

Hsu and Robbins have shown that if Xi , X 2 , . . . are independent 
and identically distributed mean zero random variables with finite vari- 
ance, then 

oo 

(1) ^P{\S n \ > en) < oo, Ve>0, 

n=l 

where S n = X\ + - ■ - + X n . Erdos 0, ^] has shown that a converse impli- 
cation also holds, namely that if ([!]) holds and the {Xi} are independent 
and identically distributed, then < oo and = 0. Since 

then, a number of extensions in several directions have been proved; 
see [fnj and |16| for partial bibliographies and brief discussions. The 
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purpose of the present paper is to prove a new rather general extension 
of the Hsu-Robbins-Erdos law of large numbers. 

Throughout, terms like "positive" and "increasing" indicate the non- 
strict varieties ( "non- negative" and "non-decreasing", respectively). 

We say that a positive sequence {x„}^ =1 satisfies Condition A 
provided that for all positive decreasing series {c n }^ =1 such that 
Yln°=i T n min(nc„, 1) converges, we likewise have Y^=i T n nc n converg- 
ing. The following Proposition gives us a simple sufficient criterion for 
Condition A. A proof will be given in Section [5], below. 

Proposition 1. Suppose that either lim inf n-,^ r n > or that both of 
the following two conditions are satisfied: 

(a) lim inf „^oo nr„ > 0, and 

(b) there is a constant C E (0, oo) such that for each n E Zq , if 
2"" 1 < k <2 n , then 

CT2»-l > 7fc > C 1 T2'i. 

Then, {r n } satisfies Condition A. 

We now state our main result. 

Theorem 1. Let Xi,X 2 ,... be independent identically distributed 

random variables. Put S n — X 1 H +X n . Let {r n }^ =1 be any positive 

sequence of numbers, and let {a n }'^L l be an increasing strictly positive 
sequence tending to oo. Furthermore, suppose there exist finite real 
constants 9 > 1, C > and N > 2 such that for all n > N we have: 

(2) ^£^!>. 

k=n K k=l 

If we have 9 > 1, then additionally assume that 

3 ™-i 

(3) liminf inf Vj'r, > 0. 

n^oo k>n kal ^ 

Then, if all of the following three conditions hold: 

(i) there is a sequence {n n }™ =l with [i n a median of S n for all n, and 
such that for all e > 0, we have YuneM r « < °°» where M = {n E 
Z + : \fi n \ > ea n }, 

(ii) Y^mLi nT nP > ea n ) < oo for all e > 0, and 

(iii) J2n=i r n e~ £2a "^ nT ^ < oo for all e > 0, where T £i „ = E[Xf ■ 
l{|Xi|<ea„}]; and where e~ 4 /° = for all t > 0, 
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we will have: 

oo 

(4) T n p (\ s n\ > ea n ) < oo, \/e > 0. 



n=l 



Conversely, if the sequence {r„} satisfies Condition A and (f|) holds, 
conditions (i), (ii) and (iii) will also hold. 

The proof will be given in Section |3|, below. The result is closely 
related to work of Klesov [jR], Theorem 4], though we are working with 
a more general class of sequences {a n }. Our proof will be based upon 
Klesov's Hoffman- J0rgensen inequality based approach, combined with 
a central limit theorem estimate of Nagaev JTJJ] , the latter being used 
rather like in 



The particular newness of the result is that it works for a n near 
the critical growth n 1 ^ 2 involved in the central limit theorem. For 
instance in the next section (see Corollary ^) we will use the Theorem 
to characterize the convergence of (f|) in the case where r n = n^ 1 and 
a-n = (nlogn) 1 / 2 (for n > 2), thereby answering a question of Spataru. 

Remark 1. Recall that a measurable function on [0, oo) is slowly 
varying (in the sense of Karamata) providing that for all A > we have 
lim^oo <j)(\x) / <j)(x) = 1. It is not difficult to see that if L and K are 
strictly positive slowly varying functions on [0, oo), and if a n = L(n)n a 
for some a > ~ while r n = K{n)n^ for some (3 satisfies liminf nr n > 0, 
then conditions @ and (0) will be satisfied for a sufficiently large 9. 
To see this, use the condition that lim inf kr^ > to observe that 
n < c Xwb=i k T k for all n > N, for some constants c and N, with c inde- 
pendent of n. Then, for sufficiently large 9, approximate YlkLn a ~k' d ^ e ' T k 
by an integral (it is here that the condition that a > | will be used; one 
will also need to use the easy fact that powers and products of slowly 
varying functions are slowly varying) and use the fact that if <fi is slowly 
varying then t~ p (fi(t) dt is asymptotic to (p — l)~ 1 x 1 ~ p (f)(x) for large 
x by Proposition 1.5.10]. This will yield (|2|). Condition (|3|) can be 
obtained by noting that L can without loss of generality be replaced by 
a normalized slowly varying function (see p. 15]) asymptotic to L, 
and then a\jk will be an increasing function for sufficiently large k if 
a > 1/3, by the Bojanic-Karamata theorem [fj, Theorem 1.5.5], so that 
the infimum on the left hand side of ([3D will be attained at k = n, and 
the truth of (0) will follow from the condition that liminf nr n > 0. Con- 
dition A will also be satisfied by {r„} under the above circumstances, 
as is very easy to see by Proposition |l[ 
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Remark 2. By a maximal inequality of Montgomery-Smith [13|, con- 
dition (|P is equivalent to: 

oo 

^^x„P(| sup Sfc| > ea n ) < oo, We > 0. 



n=l 



Kk<n 



Remark 3. Readers familiar with Hsu-Robbins-Erdos laws of large 
numbers may be surprised at condition (iii) in Theorem |I| since nor- 
mally these laws of large numbers simply have (^) equivalent to (i) 
and (ii) (under appropriate conditions on {r n } and {a n }). In gen- 
eral, condition (iii) cannot be eliminated from Theorem |l|, and seems 
to become particularly significant for a n near the critical grown n 1 / 2 . 
(Example [I] in Section will show that condition (iii) cannot be elim- 
inated if r n = n' 1 and a n = (nlogn) 1 / 2 .) However, in a number of 
special cases, condition (iii) can indeed be removed, as is seen in the 
following result. 



Theorem 2. Suppose the {r„} is positive and {a n } is increasing and 
strictly positive, and that there are finite real constants 6 > 1, C > 
and N > 2 such that for all n > N we have: 

k=n k k=l 



and 



a? 



n-1 



(6) hmmf mf -\ jr, > 0. 

n^oo k>n kaz ' 

Then, any random variable X\ satisfying condition (ii) of Theorem p] 
automatically satisfies condition (iii) of that Theorem. 

The proof will be given in Section |], below. Note that @ automat- 
ically implies @, and @ likewise implies @. 

Remark 4. It is not difficult to see that if L and K are slowly varying 
strictly positive functions on [0, oo), and if a n = L{n)n a for some a > | 
while r n = K(n)n^ for some (3 6 R satisfies liminf nr n > 0, then 
conditions (Jg) and (|]) will be satisfied for a sufficiently large Since by 
Remark [l], conditions (|2|) and (0) would allow a to be | (or in fact any 
value greater than |), this helps to further illustrate how condition (iii) 
becomes relevant close to the critical growth n 1 / 2 of a n , but for faster 
growths (i.e., around n a for a > |), it can be eliminated by Theorem |2|. 
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2. Corollaries and applications 

We now obtain the following generalization due to Baum and Katz | 
of the Hsu-Robbins-Erdos result, thereby showing that Theorem [1] is 
indeed more general than the Hsu-Robbins-Erdos law of large numbers. 



(See [3 L| for a discussion of the pedigree of the Baum and Katz result.] 



Corollary 1. Suppose that X\, X%, . . . are independent identically dis- 
tributed random variables. Let S n = X\ + ■ ■ ■ + X n . Fix r > 1 and 
< p < 2. Then the conjunction of the conditions 

(a) if p > 1 then E[Xi] = 0, and 

(b) EHX^p] < oo 
holds if and only if 

oo 

(7) ^2n r - 2 P{\3 n \ > en l ' p ) < oo, > 0. 

n=l 

Proof. Let r n = n r ~ 2 and a n = n 1 ^. Observe that (@), (|), (g), (|) and 
Condition A all hold for appropriate choices of 9 (one can use Remarks [1| 
and ^ here if one so desires, but in fact a direct verification is easy). 
Then by the Marcinkiewicz-Zygmund strong law of large numbers [T2|, 
§16. 4. A. 3], if (a) and (b) hold, then S n /a n — > almost surely, hence also 
in probability, and therefore condition (i) of Theorem |I] holds as well. 
Moreover, (ii) is equivalent to (b), and (ii) implies (iii) by Theorem^. 
Thus, by Theorem [l], if (a) and (b) hold, (0) follows. Conversely, if (0) 
holds, then since r n satisfies Condition A by Proposition |], it follows 
from Theorem [l] that (i) and (ii) (and (iii), but that is not needed) 
hold. Hence (b) holds, since it is equivalent to (ii). It remains to show 
that (a) holds. The easiest way to do this is to note that if p > 1 
then by the Marcinkiewicz-Zygmund strong law of large numbers, we 
have (S n — nE[Xi\)/a n — > almost surely, hence in probability, and 
therefore (/i n — nE[Xi])/n 1 / p 0, where median of S n , and by 

condition (i) it will then follow that £7[Xi] = 0. □ 

Recall that random variables X%, . . . ,X n are said to be K-weakly 
mean dominated by a random variable X providing that for all A we 
have: 



-y^P(\X k \>X)<KP(\X\>\) 



n 

k 



sec 



Corollary 2. Let X be a random variable and K any finite constant. 
Let {Xkn}i<k<n be a triangular array of random variables such that 
X ln , . . . , X nn are K-weakly mean dominated by X for each fixed n. Let 
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r n be a positive sequence of numbers and let a n be an increasing strictly 
positive sequence for n > 1. Put S n = X\ n +- ■ -+X nn . Suppose that (|[) 
and condition (i) of Theorem [L] hold, and that conditions (ii) and (iii) 
of Theorem |1] are satisfied with X in place of X\ . Then, 

oo 

^2r n P(\S n \ > ea n ) < oo 

n=l 

for all e > 0. 

Proof. Without loss of generality we may assume that X is symmetric 
(i.e., X and —X have the same distribution), since otherwise we can 
replace X with aX, where a is independent of X and P(a = 1) = 
P(a = —1) = |, and this replacement will not affect the weak mean 
domination conditions. By Theorem [I] we then have 

oo 

(8) T n P (\S'n\ > ^n) < OO, We > 0, 

n=l 

where S' n is the sum of n independent copies of X (condition (i) in this 
case will hold trivially by symmetry, while (ii) and (iii) were assumed in 
the statement of Corollary £|) One may slightly modify the comparison 
result in Ul9| , Corollary 1] by assuming our Theorem [lj's condition (i) in 
place of the assumption in that paper that S n /a n — > in probability, 
which modification only very slightly affects the proof (one will need 
to use fl35D , below, after obtaining the convergence of 0, series (1.2)] 
in the original proof in ||19|| ). Thus modified, fl9| , Corollary 1] together 
with (H) yields the conclusion of our Corollary ||. □ 

The following Corollary yielding a result similar to one of Hu, Moricz 
and Taylor (cf. [|, ||) can be derived from Corollary ^| exactly in 
the way that Corollary [1] was derived from Theorem [I]. 

Corollary 3. Let X be a random variable and let K be any finite 
constant. Let {Xfc n be a triangular array of random variables 
such that Xi n , . . . , X nn are K -weakly mean dominated by X . Let S n = 
X ln + --- + X nn . Fixr>\ and < p < 2. Suppose E[\X\ rp ] < oo. If 
p > 1 then assume also that E[X n i + • • ■ + X nn ] = for all n. Then, 

oo 

^n r - 2 P{\S n \ > en 1/p ), Ve > 0. 

n=l 

Now define log + x = log (2 + x). It is easy to see that Theorem |l] 
implies the following result. 
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Corollary 4. Let Xi,X 2 ,... be independent and identically dis- 
tributed random variables. Then, 

oo 

(9) J2 n ~ lp (\ S n\ > e{n\ognf /2 ) < oo, Ve > 0, 

n=2 

if and only if all of the following three conditions hold: 

(a) E[X X ] = 0, 

(b) E[X\j 'log + \X X \\ < oo, and 

( c ) T,n=2 n ~ 1 ~ £2/Te,n < 00 f° r al1 £ > °> w/iere T £ ,« = E \ X l ■ 

l{|Xi|<e(nlog n)V3}j- 

Remark 5. As per Remark §, we can replace S n by maxi<fc< n Sk in @. 

The proof of the following Lemma will be given at the end of Sec- 
tion [| 

Lemma 1. If condition (b) of Corollary |4] holds, then (S n — 
E[S n }) I ' {n\ogn) l l 2 — ► almost surely, and hence also in probability, 
as n — > oo. 

Proof of Corollary^. Let r n = 1/n and a n = (nlogn) 1 / 2 for n > 2. 
Note that (0) is easily seen to be satisfied with 9 = 1, and Condition A 
holds by Proposition [1|. Observe that (b) is equivalent to condition (ii) 
of Theorem [l] in the present setting, and that if (b) holds, then (a) is 
equivalent to (i) by Lemma [I], so that the conjunction of conditions (a) 
and (b) of Corollary § is equivalent to that of conditions (i) and (ii) of 
Theorem |l[ Also, it is easy to check that (c) is equivalent to (iii), since 
the summands in the sums in both conditions are equal. □ 

Professor Aurel Spataru has asked the author whether (§) is equiv- 
alent to the conjunction of (a) and (b). This would be expected by 
analogy with other Hsu-Robbins-Erdos laws of large numbers (such as 
Corollary [l]). It is this question that has inspired the present paper. 
In light of the Corollary f|, Spataru's question is equivalent to asking 
whether the conjunction of (a) and (b) implies (c). The following coun- 
terexample that Professor Stephen Montgomery-Smith has privately 
communicated to the author shows that the answer is negative, and 
hence so is the answer to Spataru's question. 

Example 1. Let {K m }™ =0 be a very rapidly increasing strictly positive 
sequence, with K = 0. The degree of rapidity of increase will be chosen 
later so as to make the argument go. Let ?/>(i) = (tlogt) 1 / 2 for t > 2. 
Extend if) linearly to the interval [0,2] in such a way that if>(0) = 0. 
Let be the inverse function of if). Assume that K x > 2. Let X\ be 
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a random variable such that P{X\ = i[)(K m )) = P{X\ = —ip(K m )) = 
2-™~ 1 /K m for all m, and with P(\Xi\ <£ {0}U{^j(K m ) : m G Z+}) = 0. 
Let e — 1. We have 



E[<f ) (\X 1 \)] = J22- m K- 1 -K rn = l. 

m=l 

It is easy to see that in general J5[0(|Xl|)] < oo if and only if (b) 
holds, and hence indeed (b) is satisfied in the present case. So is (a), 
since Xi is symmetric and so we can put fi n = for all n. Now, let 
M(n) = max{m G Zq : K m < n}. Then, with T^ n as in condition (iii) 
of Theorem [l|, and as K m > 2 for all m > 2 

M(n) 

T 1)n = J2( 2 ' m / K m)WK m )) 2 
m=l 

M(n) 

= ^(2- m /^ m )(ir m logir m ) 

m=l 
M(n) 

= ]T 2~"MogK m > 2- M ^\ogK M[n) . 

m=l 

Note that if K m < n < K m+ x, then M(n) = m and so 7\ )T1 > 
2~ m logK m . Thus, for m > 1 we have 

K m -\-\ K m +1 

(10) ^ n- 1 - 1 ^^ n- l - 2m ' l °^. 

n=K m +l n=K m +l 

Now, for any K > 2 and m G Z + , let L(K,m) be an integer greater 
than K and sufficiently large that: 

L(K,m) 

-2 m /\ogK 



;n) J] n -i-2"7io g K>i 



Such an L(K,m) exists because the sum on the right hand side con- 
verges. Observe furthermore that 



(12) n- l - 2m ' l °z K > C -2- m {log K){K + iy 



-2 m /\ogK 
n=K+l 
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for an absolute constant C > independent of K > 2 and m > 0. 
Combining (|10D-([n^) we see that if K m+ \ > L(K m ,m), then we have 



(13) ^=^m + l 



U(logA m J exp -2 



Inductively choosing the K m so that for all m we have both 

m _ ln , / log(K m + l) ^ 

2 (log A m J • exp -2 — > 1, 

V log K m J 

and K m+ i > L(K m , m), we then find by fll3"D that that 

OO OO -ft"m + l OO 

n=2 m=l n=K m +l m=l 

Hence Corollary f|'s condition (c) fails, and so we do have our desired 
counterexample satisfying (a), (b) but not (c), and hence by that Corol- 
lary, with inequality @ also failing. 

Although the answer to Spataru's question is negative, we do have 
the result under a slightly stronger moment condition than Corollary f|'s 
condition (b). 

Corollary 5. Let X be a random variable and let K be any finite 
constant. Let {Xfc n be a triangular array of random variables 
such that X ln , . . . ,X nn are K-weakly mean dominated by X . Assume 
that 

(a) E[X nl + ■ • • + X nn ] = for all n, and 



(b) E 
Then, 



X 2 (log+log+ \X\) 1+S 
log+ \X\ 



< oo for some 5 > 0. 



oo 1 

y^-P(\S n \ > £ (nlogn) 1/2 ) < oo, \/s>0. 

' * n 



n 

n=2 



Proof. Using Corollary |2| and the same methods as in Corollary f| it 
suffices to show that if condition (b) of Corollary |^ holds, then con- 
dition (c) of Corollary [| is satisfied with X in place of X\. To show 
this, without loss of generality (rescaling X if necessary) assume e = 1. 



A GENERAL HSU-ROBBINS-ERDOS TYPE ESTIMATE 11 

Note that if T ljn = E[X 2 ■ l{pr|<a„}]> where a n = (nlogn) 1 / 2 , then 



(14) 



Ti, n < E 

< c 

< a 



X 2 (log + log + 


x\y+ 5 ' 


log + a n 


log + 


X 




(log + log+ a n y+ s 



log + a n 



(log+ log + a n )^ 

log + n 
(log + log + nY+ 5 ' 



where S is as in (b), while C and C are strictly positive finite constants 
independent of n > 2 (but dependent on the value of the expectation 
in (b)). Hence, if N > 2 is sufficiently large that (log + log + n) 1+s > 
2C"loglogn for all n> N, then we have: 



n=N 



n- 1 - 1 ^ = ]T n ~' exp(-(logn)/T 1>n ) 

n=N 

oo 

< ^n- 1 exp(-(log + log + n) 1+<5 /C / ) 

n=N 

oo oo ^ 

< y~] n _1 exp(-21oglogn) = V — — < oo, 

n(logn) z 



n=N 



n=N 



by (p^ ) and the choice of N . Thus condition (c) of Corollary |] is indeed 
satisfied with X in place of X\. □ 



3. Proofs and auxiliary results 

Proof of Proposition [l]. If lim inf r n > and Y^=i T n min(l, nc n ) < oo, 
then there are only finitely many n G Z + for which nc n > 1 , and hence 
Y^=i T nnc n must also converge since it differs from X/nLi T n min(l, nc n ) 
only in finitely many terms. 

It remains to show that if (a) and (b) hold, then Condition A. To do 
this, suppose c n is a decreasing sequence such that 

oo 

(15) r n min(l, nc n ) < oo. 

n=l 
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Then, using (b) we have: 

oo 

oo > r n min(l, nc n ) 

n=l 
oo 

(16) > C _1 2 fc r 2fc+ i min(l, 2 k c 2 k+i) 

fc=0 
. oo 

^ ^^2 fc r 2fc+1 min(l,2 fc+1 c 2fc+ i)- 

fc=0 

Now, lim inf 2 fc r 2 fc+i > by (a), and hence it follows that only finitely 
many of the min(l, 2 fc+1 c 2 *;+i) can equal 1 (since otherwise the right 
hand side of (|T6| ) would be infinite), so that except for at most finitely 
many values of k, we have min(l, 2 k+1 c 2 k+i) = 2 k+1 c 2 k+i. It thus follows 
from (16) and (b) that 

1 oo 

> — 2 A T 2 k + 1 ■ Z C 2 k+1 



OO . 

2 

fc=0 



1 00 2k+1 ~ l j + 2 k+1 

- r i+2 fc + ! 7y C j+2 k + l 



k=0 j=0 

oo 



n=2 

and the proof is complete. □ 



Lemma 2. In the setting of Theorem [j], if the series {r n } satisfies 
Condition A, then condition @ entails (i) and (ii). 

Proof. Assume (f|) holds. Fix e > and any sequence of medians \x n 
of the S n . Let M be as in condition (i). Then, it is easy to see that 
for n G M we have -P(|S n | > ea n ) > 1/2. The convergence of J2 n eM T n 
follows immediately from this and (f|), and so condition (i) holds. 
On the other hand, by @ and the remark following the main theorem 

in 



18fl, we have 

oo 

r n min(l, nP(\Xi\ > ea n )) < oo 



n=l 



for all e > 0. Condition (ii) follows immediately from this together with 
the fact that {r„} satisfies Condition A while {a n } is increasing. □ 
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Lemma 3. Suppose that {r n } and {p n } are positive and that {b n } is 
increasing and strictly positive. Let X be any random variable. If there 
is a constant C G (0, oo) such that for all n > 2: 



n—l 

'"Tfc) 



(17) bij2pk<cj2 kT K 

k=n k=l 

then 

oo oo 

Y^PnEWX^ - l m<hn} ]. <CY,nr n P{\X\>b n ) 

n=l n=2 

Proof of Lemma [3]. Let 6q — 0. Then, by Fubini's theorem and ([HI): 



oo n 



n=2 n=2 k=l 

oo 



Y.PnEWXf ■ l m <b n }} < ^Pn^kPiPk-l < \ X \ < b k) 

n=2 k=l 

oo oo 

= J2P(b k -l<\X\<b k )b{J2pn 

k=2 n=k 
oo k— 1 

<Cj2P(h-i<\X\<b k )Y,nr n 

k=2 n=l 

oo oo 

n=l k=n+l 

oo 

= C£V n P(|X| >b n ). 



n=l 

□ 



Lemma 4. Suppose that {a n } and {f3 n } are sequences in [0,1], that 
{r n } is a positive sequence, and that r 6 Z + is such that Yl^Li T n\c*n — 

Pn\ r < OO. If J2n=l T nPn < OO, then J27=l T n a n- 

Proof. There is a polynomial p r (x,y) of degree r with coefficients de- 
pending only on r such that {x — y) r = x r — p r (x,y). Let c r be the 
maximum of p r over [0, l] 2 . Then: 

oo oo oo 

oo > ^r n |a n - (3 n \ r = ^r n |a£ - (3 n p r {a ni f3 n )\ > ^r n (a r „ - c r (3 n ). 

n=l n=l n=l 

If Yl^=i T nPn converges, then it follows that Y^n=i T n a n a l so converges. 
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Lemma 5. Let {r„} be a positive sequence and let {b n } be a strictly 
positive increasing sequence for n > 1. Let X be a random variable 
such that 



^T n nP(\X\ > b n ) < oo. 



n=l 



Fix v G [0, oo). Put Tk = Ylm=i nT n- Suppose that there is a constant 

hi 



C G (0, oo) and a 9 G [1, oo) such that 

LU0 00 



(19) 

for all n > 2, and 
(20) 



k=n 



k°r k 

bf 



|? < CT n ^ 



whenever k > n > 2. Then: 

'nE[\X\» ■ lflx.Kfc,}] 



71=1 



< CO 



The proof is based on methods of Klesov (T^, Proof of Theorem 4]. 

Proof Set iW = X ■ l { |x[<6„}- Let b = and put t„, = E[\X^\ U ] 
for n > 0. Note that t = 0. Put 5 n = t e n - t d n _ x for n > 1. For 
convenience, let 7\ = 1; redefining C if necessary, we may assume that 
( |P9"| ) and ( PU| ) also hold for n = 1. Then, since = Y^k=i ^ fe > anc ^ us i n g 
Fubini's theorem and (0): 



E 7 " 

n=l 



n) 



6 !/ 

n 



(21) 



n=l fc=l 
oo oo 

k=l n=k 
oo 

<C£5 k k?-%>*T t 



u\6 



fc-1- 



fc=l 



Let Pk = P(6fe_i < |X| <b k ). Then, note that 

(22) 4 < c(t k - h^t - 1 < cP k b u k t{-\ 

where c is a finite constant depending only on 9 and such that x e — y e < 
c(x — y)x e ~ l whenever y < x. Now, fix / G Z + . Let p n = ljb v { for n = I 



A GENERAL HSU-ROBBINS-ERDOS TYPE ESTIMATE 15 

and put p n = for all other n. Observe that by ( P0|) we have 

oo 
j=n 



for all n. By Lemma ^ (with t = v) and using (pT9|) together with the 
definition of the p n , it follows that if / > 2, then 

. oo oo 

' n=l n=l 

oo 



<Cj2 n T n P(\X\ >b n ) <00, 



n=l 



where the finiteness of the right hand side followed from (0). Thus, 



# = sup^Ztj/fof < oo. Then, t k < Kb v k /k, so that (H) yields: 

4 < cK e P k bl{bl/k) 6 -' = cK-^. 
Putting this into (pT|) , and recalling that 7\ = 1, we see that: 



n=l \ U n / k=1 

too k— 1 

fe=2 n=l 

(oo oo 

n=l k=n+l 

(oo 
Pi + ^nrnPdXil >6 n )J <oo, 

by Fubini's theorem and ([18|) . □ 

The following version of the Hoffman- J0rgensen inequality || will 
be needed for the proof of Theorem [l| in the case 9 > 1 and follows 
immediately from |TT| , Lemma 2.2]. 

Lemma 6. Let X±, . . . ,X n be independent symmetric random vari- 
ables, and let S n = X\ + • • • + X n . Then for each r e Z + there exist 
finite constants C r and D r such that for all A > we have: 

n 

P(\S n \ > A) < C r J2P(\Xi\ > X/(2r)) + D r [P(\S n \ > X/(2r))] r . 

k=l 
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Let $ be the distribution function of a (0,1) normal random variable. 
Recall that a random variable X is symmetric if and only if X and —X 
have the same distribution. 

Lemma 7. Under the global conditions of Theorem [1], suppose that 
condition (ii) is satisfied and that X\ is symmetric. Then, the following 
four conditions are equivalent: 

( a ) Yln=i T nP{\S n \ > £O n ) < oo for all e > 0; 

(b) for all 7 >lande>0we have J27=i r n [l~^ea n / (nT,^) 1 / 2 )} < 
oo, where T £n is as in Theorem [l], and where <3?(t/0) = for all 
t > 0; 

(c) there is an s > 1 such that for all e > we have Yl^i^i^ ~ 
$>{ea n /{nT £ , n ) l l 2 )] s < oo; 

(d) condition (iii) of Theorem [l] holds. 

The equivalence of (a) and (b) will be the most difficult part to prove, 
and will involve a similar method of proof to that in [ IT] , using a central 
limit theorem estimate in the present case due to Nagaev WM. In the 
case where 9 > 1, we will also need the Hoffman- J0rgensen inequality 
based methods of Klesov [ID, Proof of Theorem 4]. 

Proof of Lemma [7|. Note that: 

(23) 1 - = Tx- Xl2 x- X e~ x \\ - 0(x- 2 )) 



as x — ► oo. Using the fact that T 7£in < T £)Tl for 7 > 1, we see by (|23D 
that (d) implies (b). The implication from (b) to (c) is trivial. Suppose 
now that (c) holds. Let us^ n = a n j '(nT^) 1 / 2 '. Then, 



(24) Y. T ^>' S5Us ' n < °°> 

n=l 

for all 5 > by (c) and fl2|). Fix £ > and let 5 = £/(2s 1 / 2 ). Note 
that u$ : n > u £tTi and so 



(25) e- £2 <» < K £ uJ s n e- sS2u s- 

for all n, where 



K £ = supx s e (s52 - £2)x2 = supx s e~ £2x2/2 < 00. 

x>0 x>0 

Then, (d) follows from (^)- (|25|) , as desired. Hence (c) implies (d), so 
that we have shown that (d) =3- (b) =^> (c) (d). 

All we now need to prove is the equivalence of (a) and (b). To do 
this, assume we are in the setting of Theorem [I] and that (ii) holds. Fix 

e > 0. Let X Kn (e) = X k - l { \ Xk \<ea n }- Let S n (s) = X ln (e)-\ VX nn (s). 
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Set A n (e) = \Jl =1 {X k X kn (e)}. Observe that S n = S n (e) except 
possibly on A n (e), and that 



(26) 



J2^nP(A n (e)) < J2 nr nP(\Xi\ > ea n ) < oo, 



n=l 



n=l 



by (ii). It follows from (|26|) and from the equality of S n and S n (e) 
outside A n {e) that (a) holds if and only if 



(27) 



^r n P(|5 n (£)|>£a n )<oo, V £ > 0. 



n=l 



We now need only show that ( ^7J ) holds if and only if (b) holds, and 
we will be done. Note that T £j „ = E[{X\ n {e)) 2 ]. Fix 7 > to be chosen 
later as needed. Then, since all the Xk n {s) and S n (e) have mean zero by 
symmetry, and since Xi n (e), . . . ,X nn (e) are identically distributed for 
a fixed n, by Nagaev's central limit theorem estimate |14[ Theorem 3] 
we have: 



(28) 



P(\S n (e)\ >iea n )-2 



1 - $ 



1 £a r, 

nT 1/2 

IvJL e.n 



< cn 



E[\X ln (e) 



for an absolute constant c < 00. 

Observe that if (0) holds for some 6, then it also holds for all greater 
values. We now have a quick proof if 9 = 1. For then, by (|28|) (with 
7 = 1) we can see that the equivalence of (b) and (p7|) would follow as 
soon as we could show that we have 

E[\X ln (e)^ 



(29) 



E 

n=l 



UTr, 



< 00. 



But ( p9|) follows from the validity of (pD for 6 = 1 and from condi- 
tion (ii) of Theorem [l], by an application of Lemma |3] with p n = nT n /a^, 
X = Xi, t = 2 and b n = ea n . 

Suppose now we are working with 6 > 1, so that (|3|) also holds. Let 
r be an integer greater than or equal to 9. I now claim that: 

131 



(30) 



E 

n=l 



nE X ln (e) 



< 00, 



> 0. 



Suppose for now that this has been shown. If (a) holds, then as noted 
before, fl27D does likewise. Letting a n = 2[1 — $(ea n /(nT e n ) 1//2 ))] and 
f3 n = P(\S n (e)\ > ea n ), we see that by fl27p together with (|30D and 
(|28|) (with 7 = 1), we do have the conditions of Lemma [| satisfied, so 
that Yl™=i T n a n < °°5 an d hence (c) follows, whence (b) follows by the 
already proved equivalence of (b), (c) and (d). 
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Conversely, suppose (b) holds. This time letting f3 n = 2[1 — 
$(7£a n /(nT £i „) 1/2 ))] and a n = P(\S n (e)\ > ^6a n ), using (b), together 
with (p8|) , ( p0|) and Lemma §, we see that Xl^Li T nOt r n < oo, i.e., 

oo 

(31) ^2r n [P{\S n {e)\ > j£a n )] r < oo. 

n=l 

Let 7 = (2r) _1 . By the Hoffman- J0rgensen inequality (Lemma |6|), we 
have: 

oo 

Yr n P{\S n {e)\ >ea n ) 

oo oo 

< C r J2r n P(\X n (e)\ > jea n ) + D r J2r n [P(\Sn(e)\ > jea n )] r . 



n=l 



n=l n=l 



It is easy to see that the first sum on the right hand side is no greater 
than Y^Li T nP{An{l e ))^ which converges by (0), and the second con- 
verges by (|3TD. Hence, (|27| ) follows, and as already shown this implies 
(a). 

Hence, all we need to show is that (^) holds. Changing finitely 
many values of a n and r n , we may assume that holds for all n > 2, 
and that (|3|) gives: 

(32) sup^ < C"^nr n , 

k>n a k k=1 

for a finite C. We can now apply Lemma || with v = 3, b n = ea n , 
and X = X\, using the assumed condition (ii) of Theorem [l] to guar- 
antee (|i~8l) , and getting (|T9|) and (|20|) (with an appropriately chosen 
constant) from (^) and (|32|) (which hold for all n > 2 by assumption), 
respectively. The Lemma then immediately yields (|30D and the proof 
is complete. □ 

Proof of Theorem [I]. Let ai,a2, ... be a sequence of independent 
Bernoulli random variables with P(a n = 1) = P(a n = —1) = |, and 
with the sequence independent of {X n }^ =1 . Let X' n = a n X n , and put 
S' n = X[ + ■ • ■ + X' n . Note that the primed variables are symmetric. 

Suppose first that (|j) holds and {r n } satisfies Condition A. By 
Lemma we have (i) and (ii) holding. It remains to show that (iii) 
holds. But, if (H) holds, it likewise holds with S' n in place of S n , as can 
be seen by conditioning on the {ak}^ =1 and using |L3], Corollary 5]. But 
then by the implication (a) (d) of Lemma [7] applied to the primed 
variables (which are symmetric) it follows that (iii) holds with X[ in 
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place of X\. But (iii) holding for X[ is equivalent to it holding for X\, 
and so (iii) follows. 

Conversely, suppose (i), (ii) and (iii) hold. Evidently (ii) and (iii) will 
also hold with X[ in place of X\. Hence by the implication (d) =>■ (a) 
of Lemma [7| as applied to the primed variables we have 

oo 

(33) T n P (\ S 'n\ > £«n) < OO, V £ > 0. 

71=1 

Now, for any random variable Y, let Y s = Y — Y be the symmetriza- 
tion of Y, where Y is an independent copy of Y. We shall take 
symmetrizations in such a way that . . . are independent and 

Si^ = X{ + h X^ for all n. Now, since 

P(\X s k \ > A) < P(\X k \ > A/2) + P(\X k \ > A/2) 
= 2P(|2X fe |>A)=2P(|2X^|>A), 



for all A > 0, it follows from |19|, Theorem 1] that there is an absolute 
constant c > such that 

P(\S s n \ > A) < cP(\2S' n \ > A/c) 

for all A > 0. By (M) it then follows that 



J2r n P(\S a n \ >ea n )<oo, Ws > 0. 



n=l 



By standard symmetrization inequalities 0, §17.1. A] it follows that 



(34) T nP(\Sn -Hn\> £ a n) < OO, Ve > 0, 

n=l 

where \x n is the median of S n occurring in (i). Now, for any e > we 
have 



(35) J2r n P{\S n \ > ea r 



n=l 



< r n P{\S n -n„,\> ea n /2) + ^ r n ■ l { | Mn | >ean / 2 }. 

n=l n=l 

By condition (i), the second sum converges, and by (|34f) , so does the 
first, and hence (§) follows. □ 

Proof of Theorem 0. Assume condition (ii) of Theorem |l] holds. Fix 
e > 0. Changing a finite number of values of r n and a n and using fl5|) 
and (^|) will let us assume that if we let h n = £a n and v = 2, then 
conditions (|1|) and (|20|) of Lemma § will be verified for an appropriate 
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constant. Applying that Lemma and using condition (ii) of Theorem |] 
shows that: 

oo 

(36) y^T n na~ 2 T £)n < oo, 

n=l 

where T £j „ is as in Theorem |l](iii). Now, using the elementary inequality 
g- 1 /^ < 4<£ 2 which is valid for all x > 0, we see that (BSD entails that 



71=1 

and so (iii) is true. □ 

Proof of Lemma [TJ. Let a n = (nlogn) 1//2 for n > 2. Assume the con- 
ditions of the Lemma hold. Without loss of generality = 0. 
Let Y n = X% ■ l{|Xi|<a„}- Observe that Condition (b) of Corollary |] is 
equivalent to the claim that ^^L 2 -^(l-^il — a «) < 00 ' anc ^ no ^ e that 
Ylk=n^-/ a k = 0( n / a n) as n — > oo. Therefore, by Jl5], Theorem VI. 15, 
p. 225], we will have S n /a n — > almost surely if and only if we can 
show that 

(37) lim ^J^O. 

To prove first let U n = X 1 - Y n . Observe that E[U n ] = —E[Y n ] 
by condition (a) of Corollary ||. Hence, we only need to show that 
a^nElUn] — > 0. Now, since \U n \ > a n whenever U n ^ and as 
x^ 1 log + x is decreasing in x > 0, we have (using the convention that 
(0 2 /log + |0|)-(log + |0|)/|0| = 0): 

a- l nE[\U n \] = a- l nE\(Ul/ log + \U n \) • (log + \U n \)/\U n \) 
< a^nEHUll \og + \U n \) ■ (log + a n )/a n ] 
= (\og + a n )na- 2 E[(U 2 n /\og + U n )} - 0, 

since (log + a n )na~ 2 is bounded while E[{U 2 / log + U n )} — > by dom- 
inated convergence, as U n — > almost surely and ?7 2 /log + ?7 n < 
X 2 / log + Xi, whereas X\j log+ X x G L 1 by (b). " □ 
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